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Abstract 

We obtain a version of Noether's invariance theorem for optimal con- 
trol problems with a finite number of cost functionals. The result is ob- 
tained by formulating E. Noether's result to optimal control problems 
subject to isoperimetric constraints, and then using the unimprovable 
(Pareto) notion of optimality. A result of this kind was posed to the 
author, as a mathematical open question, of great interest in applications 
of control engineering, by A. Gugushvili. 
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1 Introduction 

E. Noether's Theorem, which relates symmetries and conservation laws, is one 
of the most deep and rich, powerful and helpful results of physics. It describes 
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the fundamental fact that "invariance with respect to some group of parameter 
transformations gives rise to the existence of conservation laws". Typical ap- 
plication of conservation laws is to lower the order of the systems. They are, 
however, a useful tool for many other reasons, e.g., to prove regularity of the 
minimizers in the calculus of variations and optimal control Noether's the- 
orem comprises all results on conservation laws known to classical mechanics. 
Thus, for instance, the invariance relative to translation with respect to time 
yields conservation of energy; while conservation of linear and angular momenta 
reflect, respectively, translational and rotational invariance. Noether's theorem 
is applicable also in quantum mechanics, field theory, electromagnetic theory, 
and has deep implications in the general theory of relativity. It is useful to 
explain a myriad of things, from the fusion of hydrogen to the motion of plan- 
ets orbiting the sun Moreover, it turns out that Noether's theorem is much 
more than a theorem: it is a principle, which can be formulated, as a theorem, in 
many different contexts, under many different assumptions. It is possible, e.g., 
to formulate the classical Noether's theorem of the calculus of variations for big- 
ger classes of nonsmooth admissible functions [10] ; in the more general context 
of optimal control 00; or to obtain discrete-time versions . For an account 
of Noether's symmetry principle in the context of optimal control, the use of 
conservation laws to integrate and decrease the order of the equations given by 
the Pontryagin maximum principle and for practical examples, such as the 
problem of synchronization of difficult control systems, we refer the reader to 
0. Here we are interested in generalizing the previous results to cover optimal 
control problems which, in place of a single cost functional, have a vector- valued 
functional to minimize. For an introduction to problems of optimal control with 
multiple objectives, we refer the reader to Salukvadze's book 5,- Multiobjective 
optimal control attracts more and more attention, and is source of many open 
questions 0. The motivation for the present study was a challenge proposed 
to the author by A. Gugushvili on November 18, 2003. A. Gugushvili wanted 
to generalize the symmetry and conservation laws to multiobjective problems of 
optimal control: "We would like to develop E. Noether's theory for multicrite- 
ria optimal control systems. If you have any ideas and work on these problems, 
please, let us know. " Theorem 14.21 is, to the best of our knowledge, the first 
attempt in this direction. 



2 Optimal Control with Isoperimetric Constraints 

It is well known that necessary optimality conditions for optimal control prob- 
lems subject to isoperimetric constraints, are also necessary for unimprovable 
(Pareto) optimality in the problem with a vector- valued cost (cf., e.g., 
Chap. 17], p. 22]). Consider a nonlinear control system, 

x{t) = ^{t,x{t),u{t)) , (1) 
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of n difFerential equations, subject to k isoperimetric equality constraints, 



b 

g^{t,x{t),u{t))dt^^,, i^l,...,k; (2) 



m isoperimetric inequality constraints, 

rb 



gj {t,x{t),u{t)) < , j = fc + 1, . . . , fc + m; (3) 
and 2n boundary conditions 

x{a) = a , x{b) = (3 . (4) 

The problem consists to find a piecewise-continuous control function u(-) = 
(ui(-), . . . taking value on a given set Q. C W , and the corresponding 

state trajectory x{-) = (a;i(-), . . . ,a;„(-)), satisfying ||2J), and which 
minimizes (or maximizes) the (scalar) integral cost functional 

I[x{-)M-)] = / L{t,x{t),u{t))dt. 



This problem is denoted in the sequel by {Pi). Both the initial time a and ter- 
minal time b, a < b, are fixed. The boundary values a, f3 € R", and constants 
^i, I = 1, . . . , fc + m, are also given. The functions L(-, •, •), (^(•, •, •) and g{-, •, •) 
are assumed to be continuously differentiable with respect to all variables. The 
celebrated Pontryagin's maximum principle 0] gives necessary optimality con- 
ditions to be satisfied by the solutions of optimal control problems. Formulation 
of the maximum principle for problems with isoperimetric constraints can be 
found, e.g., in §13.12]. 

Theorem 2.1 (Pontryagin Maximum Principle for (Pi)). Let u{t), t £ 
[a, 6], be an optimal control for the isoperimetric (scalar) optimal control problem 
(Pi), and x{-) the corresponding state trajectory. Then there exists a constant 
^/iQ < 0, a continuous costate n-vector function ?/'(■) having piecewise-continuous 
derivatives, and constant multipliers Xi, i — 1, . . . , k+m, where {ipQ, A) ^ 0, 
satisfying the pseudo-Hamiltonian system 

|i(t) - If (i,a;(t),w(i),V'o,^(t),A) , 

the maximality condition 

H {t,x{t),u{t),%l)Q,%jj{t),\) = laa-xH (t,x(t),u,ipo,^{t), X) ; 

It GO 

where the Hamiltonian H is defined by 

H(t, X, u, Tpo, A) = 'ipoL{t, x,u) + ip ■ ip{t, x,u) + X ■ g(t, x, u) . (5) 
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Moreover, Xj < 0, j = k + 1, . . . , k + m, where Xj = if 



b 

9j {t,x{t),u{t)) < ; 

and H(t,x{t),u(t),'ipOi4'{t)-i ^) is a continuous function of t and, on each interval 
of continuity ofu(-), is differentiable and satisfies the equality 

dH OH 

— (t, x{t),uit), ^Po, ^it),X) = ^ {t, x{t),u{t), ^Po, ^it),X) ■ (6) 
at at 

3 Vector- Valued Optimal Control Problems 

When optimal control is used to model a real problem, it is natural that several 
(conflicting) cost functionals ("objectives") are desired to be taken in account 
(see [5] for many practical situations). The problem is then to minimize a 
vector- valued functional with components 

h[x{-),u{-)]^ I L,{t,x{t),u{t))dt, i = l,...,N, 



subject to a dynamical control system and boundary conditions (QJ. We 
denote this problem by (P). 

Definition 3.1. An admissible pair {x{-),u{-)) is said to be an unimprovable 
solution, compromise solution, or a Pareto solution for (P) if, and only if, for 
every admissible pair {x{-),u{-)), either 

lM-).i^i-)]^h[x{-),u{-)] Vie {!,..., TV}, 

or there exists at least one i e {1, . . . , A^} such that 

h[x{■),ui■)]<I^H■),M■)]■ 

It turns out that necessary conditions for optimal control problems with 
isoperimetric constraints, are also necessary for Pareto-optimality of optimal 
control problems with a vector- valued cost. Theorem l3.1l is a simple consequence 
of Definition EH (cf., e.g., Theorem 17.1]). 

Theorem 3.1. // (i(-), t2(-)) is a Pareto-solution of problem (P), then it is 
a minimizer for the isoperimetric optimal control problems with the integral 
scalar-valued cost 

h[x{-),<-)]. ^ e {i,...,iV}, 

and isoperimetric constraints 

lM-)^0] <l3[i{-)M-)]. ] = l,...,N and]^i. 

From Theorems 13.11 and 12.11 (Pontryagin maximum principle for problems 
with isoperimetric constraints) it follows the so called "general theorem of op- 
timal control" (cf. 'S', p. 22]). 
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Theorem 3.2. // (x(-), is a Pareto- solution of problem (P), then there 
exists a continuous costate n-vector function tpl-) having piecewise- continuous 
derivatives, and constant multipliers A = (Ai, . . . , Aat), where {ip(-),X) ^ 0, 
satisfying the pseudo-Hamiltonian system 

x{t) =^{t,x{t),u{t),ij{t),X) , 
V-W =-^it,x{t),u{t),,p{t),X) ; 

the maximality condition 

H {t, x{t),u{t), ^{t), A) — maxH {t, x{t),u, A) ; 

where the Hamiltonian Ti. is defined by 



H{t, x, u,%Ij,\) — X ■ L{t, x,u) + ijj ■ (p{t, X, u) . (7) 

Moreover, Xj < 0, j — l,...,N; and 'H{t,x{t),u{t),^j{t),X) is a continuous 
function oft and, on each interval of continuity of u{-), is differentiable and 
satisfies the equality 

dl~L d^hC 

— (t, x{t),u{t), ^{t), A) = — (i, x{t), uit),^Pit),X) . 



4 Main Results: Noether-type Theorems 

Theorem 14.11 asserts that the presence of a symmetry for the optimal con- 
trol problems involving equality and inequality isoperimetric constraints, imply 
that their Pontryagin extremals (and solutions) preserve a well-defined quantity 
(there exists a conservation law associated with each symmetry). The result is 
formulated, as it happens for the problems of the calculus of variations ^Uli and 
for the unconstrained scalar-valued continuous [7] and discrete-time |S] optimal 
control problems, as an instance of Noether's universal principle. 

Definition 4.1. An equation C {t, x{t), u{t), tpo, ip{t), A) — constant, valid in t G 
[a, b] for any quintuple (x(-), u(-), ipo, A) satisfying the Pontryagin maximum 
principle (Theorem 12. is called a conservation law for problem (Pi). 

Theorem 4.1 (Noether theorem for optimal control problems with 
isoperimetric constraints). If there exists a C^-smooth one-parameter group 
of transformations 

h' : [a, b] X R" x M'' ^ M x R" x , 
h^(t,x,u) — {T{t,x,u, s), X{t,x,u, s),U{t,x,u, s)) , 
s G (-£, e) , £ > , 
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with h°{t, X, u) = (t, X, u) for all it, x, u) £ [a, b] x R" x W , and satisfying 
L {t, x{t),u{t)) ^Loh" {t, x{t), u{t)) (t, x(t),u{t), s) , 
(t, x{t), uit),s) ^^oh' (t, x{t)Mt)) jT {t, x{t), u{t),s) , 



' {t, x{t),u{t)) =goh' (i, x{t), u{t)) -T {t, x{t),u{t), s) , 



(8) 
(9) 
(10) 



then, 



,p(t)- — X{t,x{t),u{t),s)\^^„ 



d 



- Hit, x{t), u{t),ijQ,i^{t),X)— T {t, x{t), u{t), 

OS 



— const 



is a conservation law for problem (Pi), with H the Hamiltonian Q associated 
to the problem (Pi). 

Proof. Using the fact that ft.°(t, x, u) — {t, x, u), from condition (jSJ one gets 



= 



ds 



Loh" (t, x{t), u{t)) —T (t, x{t), u{t),s) 



dL 


dT 




dL 


dX 




dL 


dU 


dt 


ds 


H 

s=0 


dx 


ds 


H 

s=0 


du 


ds 



s=0 



L— — 

dt ds 



(11) 



s=0 



while condition and 1)10(1 yields 



d_ 5X 
dt ds 



s=0 



dip dT 
'dt 97 



s=0 



dip dX_ 
dx ds 



s=0 



dip_ dU 
du ds 



d dT 
dt ds 



s=0 



dg_ dT 



dg_ dX_ 

dx ds 



dg_ dU 

du ds 



d dT 
' dt ds 



(12) 
(13) 



Multiplying by -00, by V'(0; and by A, we can write: 



dL dT 
'dt 97 
dip dT 
'dt 97 



dt ds 



s=0 



dL dX 
dx ds 
dip dX_ 
dx ds 
dg_ ax 
dx ds 



+ 



s=0 



du ds 

dip dU 

du ds 

dg_ dU_ 

du ds 



s=0 



d dT 
dt ds 
d dT 
dt ds 
d dT 
^ dt ds 



s=0 



d dX 
dt ds 

0. (14) 



According to the maximality condition of the Pontryagin maximum principle, 
the function 



-00^ (i, x{t), U (t, x{t),u{t), s)) + ij){t) ■ ip (t, x{t), U (t, x{t),u{t), s)) 

+ X-g{t, x{t), U {t, x{t), u{t),s)) 



6 



attains an extremum for s = 0. Therefore 



iP — — 

du ds 

and (|14|l simplifies to 



du 



du ds 



= 



dL dT 
'dt 97 

-m 



+ 



s=0 



dX 
dx ds 



L 



s=0 



d dT 
dt ds 



dip dT 
dt ds 

+ X- 



s=0 

dg dT 
'dt 9^ 



dip dX_ 
dx ds 



+ 



s=0 

d dT 

dg dX 



dt ds 



s=0 
OH 



dx ds 
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s=0 



s=0 

d dT 
dt ds 



d dX 
dt ds 



.0. (15) 



From the adjoint system ijj — and the equahty we know that 

dt 

and one concludes that (|15l) is equivalent to 



dL 




— - A • 

dx 


d£ 


dx 


dx 


dL 






dg 




dt 



^ , , , , dX 

37 m ■ ^ 



dt 



ds 



s=0 



ds 



s=0 



0. 



The proof is complete. □ 
We now introduce the notion of unimprovable or Pareto conservation law. 

Definition 4.2. An equation C {t,x{t),u{t),tp{t), X) — constant, valid in t g 
[a,b] for any quadruple {x{-),u{-),'ijj{-), X) satisfying the "general theorem of 
optimal control" fTheorem K12|l . is called an unimprovable conservation law or 
a Pareto conservation law for problem (P). 

Given the relation between problems (Pi) and (P) (cf. Section|2Il, we obtain 
from Theorem 14. II the following corollary. 

Theorem 4.2 (Noether theorem for vector-valued optimal control sys- 
tems). // there exists a -smooth one-parameter group of transformations 

h" : [a, 6] X R" X M'' ^ M X R" x W , 
h^{t,x,u) — (T{t,x,u, s),X{t,x,u, s),U{t,x,u, s)) , 
s e (-£, e) , e > , 

with h^{t,x,u) = {t,x,u) for all (t,x,u) £ [a,b] x M" x R^, and satisfying 

^X (t, x{t), u{t),s) ^poh' {t, x{t),uit)) ^T (t, xit), u{t),s) , (16) 
dt dt 



L (t, x(t],u(t)) ^Loh' (t, x(t), u(t]) —T (t, x(t],u(t), s) 

dt 



(17) 
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(L = (Li, . . . ,Ln)) then, 



m ■ — X {t,x{t),u{t),s)\^^^ 

d 

-nit,x{t),u{t),^P{t),\)—T{t,x{t),u{t),s)\. = const (18) 
OS 

is an unimprovable conservation law for problem (P), with Ti. the Hamiltonian 
(Q associated to the problem (P). 

Remark 4.1. Theorems 14.11 and 14.21 are still valid in the situation where the 
boundary values of the state variables and/or the initial-terminal instants of 
time (a, b) are not fixed. We have considered conditions I0J and fixed both 
initial and terminal times, only to simplify the presentation of the Pontrya- 
gin maximum principle: initial and terminal transversality conditions are not 
relevant in the proof of our Noether-type theorems. 

In the next section we illustrate Theorem 14.21 with an example of five state 
variables (n — 5), two controls (r = 2), and two functionals to minimize {N = 2). 



5 Example for the Flight of a Pilotless Aircraft 

We borrow from §3.4] the problem of optimizing a vector functional with two 
components, representing fuel expenditure (/i) and flight-time {I2), 

h= I Ui{t)dt, l2= [ Idt, 
Jo Jo 

subject to a dynamical control system representing the motion of a pilotless 
aircraft 

'xi{t) ^X3{t), 
X2{t) =X4{t), 

< Xsit) = ci^^cos{u2it)) , 

i4{t) =Ci^j|^sin(M2(t)) -C2, 
^X5{t) =-Ui{t). 

Here xi is the range of the aircraft; X2 the altitude; 2:3 the horizontal component 
of the velocity; X4 the vertical component of the velocity; X5 the mass of the 
aircraft (which depends of its fuel); ui the rate of fuel consumption; U2 the thrust 
angle relative to the horizontal; ci and 02 given constants. A full description of 
the model, and a complete analysis of its solution, is found on [S] §3.4]. Our 
objective here is to obtain a non-trivial unimprovable conservation law for the 
problem, with the help of Theorem 14.21 About the model, it is enough for 
our purposes to say that there are physical constraints on the control values, 
under which makes sense to consider tan(u2) (cf. (3.42)]). Two trivial 
unimprovable conservation laws are ipi{t) — const (obtained from Theorem 14.21 
choosing T = t, Xi = xi + s, Xi — Xi, i — 2,..., 5, Uj = Uj, j = 1,2), 
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and ip2{t) = const (obtained from Theorem 14.21 choosing T — t, X2 = X2 + s, 
Xi = Xi, i = 1,3, 4, 5, Uj — Uj, j — 1,2). We claim that 

V'la^iCi) + 2ilj2X2it) + ipi{t)x^{t) + 2ijji{t)xi{t) = const (19) 

is also an unimprovable conservation law for the problem. We remark that H19|l 
is non-trivial, and difficult to obtain without Thcorem l4.2l To prove it with the 
help of Theorem l4.2l one just need to show that the problem is invariant (satisfies 
conditions l(TB|) and ((TTIl ') with T ^ t, Xi — e^xi, X2 — e'^''x2, X^, — e'^xs, 
X4 = e^*X4, X^ = 2:5, Ux = Ul, and U2 = arctan (e* tanu2) (sinJ72 = e^'^sinu2, 
cosi72 = COSU2). This is done by direct calculations {-^T = 1): 

at dt 

lx2=e'^X2 = e'^x, = xAT, 
dt dt 

d „ Ul Ul d 

— X3 = e ±3 = ci — e C0SU2 = ci— cos[/2— T, 
dt X5 A5 dt 

d V 2s ■ ""1 2s ■ f Ul \ rr. 

— A4 = e ■ Xi = ci — e sm ^2 - C2 = ci — sm (72 - C2 —T, 
dt x^ \ A5 / dt 

^X5 = ±5 = -Ul = -Ui-^T, 
dt dt 

and equations are verified; 

Li = Ul = Ui-^T , 
dt 

and equations ((T7|l are also satisfied. Equality ((TS|l takes then form (fT^ . 
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